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[57] ABSTRACT 

A self keyer with background gap fill adds background 
video to the gap between the background video and a 
fill video resulting from self key error. The self keyer 
performs the general function: 

Composite = F21 *f(Kcy) + Background *(1 - f- 
(KejO-CKey)) 

where f(Key) is a programmable transfer function used 
to generate a multiplication factor, fl[Key), for shaping 
or reshaping the fill video and to generate a hole cutting 
signal, f(Key)*(Key), for shaping the background 
video. The shaped foreground and background videos 
are combined to generate a composite video. The trans- 
fer function may be generated and stored in a PROM/- 
RAM buffer as a lookup table by a CPU. The transfer 
function may also be generated interactively by adjust- 
ing various points on the transfer function individually, 
with the CPU storing the resulting transfer function in 
the PROM/RAM buffer. 

8 Claims, 6 Drawing Sheets 




BKGD- 



INPUT 
KEY ~ 



f (KEY) KEY^f (KEY) 



















24 




PROM 
/RAM 




PROM 1 
/RAM \ 



KEY*f (KEY) 



>L ! KEY 


PROM 






/RAM 



KS I 



>CPU j 
I 



24 



CPU 



p° if 



KEYO- 



07/08/2004, EAST Version: 1.4.1 



U.S. Patent 



Jan. 31, 1995 



Sheet 1 of 6 



5,386,242 




07/08/2004, EAST Version: 1.4.1 



U.S. Patent Jan. 31, 1995 Sheet 2 of 6 5,386,242 




07/08/2004, EAST Version: 1.4.1 



U.S. Patent Jan. 31, 1995 



Sheet 3 of 6 5,386,242 




07/08/2004, EAST Version: 1.4.1 



U.S. Patent 



Jan. 31, 1995 



Sheet 4 of 6 




07/08/2004, EAST Version: 1.4.1 



U.S. Patent Jan. 31, 1995 



Sheet 5 of 6 



5,386,242 




07/08/2004, EAST version: 1.4.1 



U.S. Patent Jan. 31, 1995 Sheet 6 of 6 



5,386,242 




07/08/2004, EAST version: 1.4.1 



5,386,242 

1 2 

ing in some edges too light and others too dark, with 
SELF. BEYER WITH BACKGROUND CAP FILL glassware taking on a gray lackluster appearance. 

Another method of reducing the appearance of the 
BACKGROUND OF THE INVENTION gap is disclosed in U.S. Pat No. 5,146,333 issued Sep. 8, 

The present invention relates to video keyers, and 5 l J^J° P^l^^^.f 11 ^. ?° ya tU ™£ 
more particularly to a self keyer that uses background ^Emphasized Ful Video". In th>s technique the fill 
video to fill gaps in a composited video scene. T^^^^f at the edges so that the error in 

Keymg is fvideo procea where two or more video theself key that produce gap is reduced, 
signals are composited together into a single scene, such ,„ What is desiredis a self keyer that improves the ap- 
as a weatherman placed in front of a weather map. 10 pearance of composited scenes. 
Currently there are two distinct algorithms for compos- SUMMARY OF THE INVENTION 

iting two scenes into one scene: CO a matte or additive .. , it _ . . . 

key; or (ii) a multiplicative key. . Accordingly the present mvennon provides a self 

For an additive key a fill video signal that is already lc *J« ^th background ^gap fill that presets a self key 
shaped, Le., the fill video signal is processed so that it 15 ^ bv de ? OTU ^ 8 1 the <hSel ^ °* deal 

appears against a black background, and a key signal f^'fCf The self keyer uses the 

thatdescribes where the fill video signal occupies the self key error to ^r* the background video for a corn- 
scene are required. The additive key follows the equa- P<»rte scene to add a bit of die background video m the 
^ on . gap between foreground and background videos caused 

20 by the self key error. A key signal is derived from a fill 
Comporite«Shaped Fffl+ Background^ -Key) video. The key signal is processed to produce a control 

signal that is a function of the key signal according to a 
The fill video is simply added to a hole that is cut in the specified transfer function for shaping the fill video, 
background video by the key signal A special case of a The control signal and key signal are also used to gener- 
source for an additive keyer is a chroma key circuit. 25 ate a mixer control signal for cutting a hole in the back- 
U.S. Pat No. 4,409,611 issued Oct 11, 1983 to Petro ground video, Le., shaping the background video. The 
Vlahos entitled '^Encoded Signal Color Image Compos- shaped fill and background videos are combined to 
iting" is an example of additive keying as applied to produce a composite video representing the composite 
chroma keys. scene. The multiplication of the transfer function by the 

For a multiplicative key the fill video needs to be 30 key signal serves to provide additional background 
shaped or reshaped to define the portion of the fill video video to fill the gap between the shaped fill and back- 
that is to become part of the composite. The multiplica- ground videos. 

tive key follows the equation: The objects, advantages and other novel features of ' 

the present invention are apparent from the following 
Omipositc=Fill*Kcy+Backgroand*(l —Key) 35 detailed description when read in conjunction with the 

appended claims and attached drawing. 
A special type of multiplicative key is a self key where nPSPRlPTION OF THF r>R AWTNfi 

the key signal is derived from the fill signal itself. U.S. BRIEF DESCRIPTION OF THE DRAWING 

Pat No. 4,920,415, issued Apr. 24, 1990 to Daniel J. FIG. 1 is a block diagram of a self keyer according to 
Chaplin entitled "Self Keyer", shows an example of 40 the present invention. 

multiplicative self keying in FIG. 1. FIG. 2 is a block diagram of an alternate embodiment 

The difference between the two keying methods is for a portion of the self keyer according to the present 
that the multiplicative key shapes or reshapes the fill invention. 

video while the additive key simply adds the fill video FIG. 3 is a graphic diagram illustrating a first transfer 
to a hole cut in the background by the key signal Al- 45 function for the self keyer according to the present 
though additive keys appear to be more correct since invention. 

the edge of the fill is not distorted, there are many in- FIG. 4 is a graphic diagram illustrating a second 
stances where self keys are used since they may give a transfer function for the self keyer according to the 
better result visually by providing a softer appearance present invention. 

with less noise. 50 FIG. 5 is a graphic diagram illustrating a third trans- 

The problem with self keys is that reshaping the fill fer function for die self keyer according to the present 
video distorts the edge of the fill video so that when it invention. 

is added to the hole in the background video, the two FIG. 6 is a graphic diagram illustrating a fourth trans- 
scenes do not add up— there is a gap which shows as a fer function for the self keyer according to the present 
black line around the fill part of the composited scene. 55 invention. 

To combat this problem traditionally the derivation of FIG. 7 is a plan view of an interface for the self keyer 

the key signal is made with a variable gain comparator according to the present invention. 

which is set for high gain with a high clip value. This FIG. 8 is a plan view of an alternative embodiment of 

narrows the gap between the background and fill video the interface for the self keyer according to the present 

edges, but is unpleasant in appearance because the edges 60 invention. 

of the resultant key are harsh and any edge noise is ^™«»«—^t ^ 

noticeable. DESCRIPTION OF THE PREFERRED 

The above mentioned U.S. Pat No. 4,920,415, to EMBODIMENT 
reduce the appearance of the gap, fills the gap with a Referring now to FIG. 1 a multiplicative keyer 10 
variable luminance level By varying the luminance 65 with self key is shown according to the present inven- 
level a balance is made between the fill and background tion. A fill video signal FILL is input to a first summa- 
that subjectively reduces the visual impact Unfortu- tion circuit 12 to remove black setup from FILL so 
nately the gray level often is only a compromise, result- there is only one black setup level in the self keyer 10, 
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and also to a clip and gain circuit 14 via a key switch switch FS is in the normal position. However some 

KS. The output of the clip and gain circuit 14 is a key character generators produce a "shaped" fill video sig- 

signal KEY, which is either a self key signal or an ester- nal and associated key signal, but the shaped fill is big- 

nal key signal depending upon the position of the key ger than the key so that the key defines the resultant 

switch KS. A black video signal BLK is subtracted 5 edge. This allows the result to be anti-aliased since the 

from FILL in the first summation circuit 12, and the character generator went to a lot of trouble to produce 

result is input to a first multiplier circuit 16. A control m anti . a i iased key. In this case a conventional multipli- 

«J ° f !f *^ cative keyer does not produce a gap, and the switch FS 

applied to the first mutopher circuit 16, and the ou^m alternative position. 

is a shaped or reshaped fill video signal FILL'. BLK i 0 ^ - w - f w - c ctinM1 . mr . 

and a ba^unTviteo signal BKGD are input to a " An al^^e transform circmtnjsJio^mFlG, 
mixer 18 Eg a controSinal at which aWol * * embodnnent a second PROM/RAM 30 re- 
key signal, as discussed below, is applied The mixer 18 P^ces the second multiplier 26 and switch FS. The 
produces an output according to the following equa- second PROM/RAM 30 contains the transfer function 
tion. 15 KEY*f(KEY). As above the CPU may select different 

functions as a result of operator action, and may down- 
out=x*y+(i-X)«z load functions to the PROM/RAMs 24, 30. When the 

multiplicative keyer is not a self key, the selection of the 
which cuts a hole in BKGD and fills the hole with BLK function being applied to BKGD is the same as f(KEY), 
where FELL is to appear in a composite scene. The m accomplishing the same thing as the switch FS above 
outputs from the mixer 18 and from the first multiplier The transform circuits 22, 22' perform a general form 
16 are combined in a second summation circuit 20 to equation for a self keyer as follows: 
produce a composite video signal that represents the 

composite scene. Applying the output from the clip and Composiic=FiLL*£CKEY)+BKGD*(i -KEY*f- 

gain circuit 14 directly as the control key signal for the (KEY)) 
mixer 18 and as the control signal for the first multiplier 

16 produces a multiplicative keyer as shown in the When f(KEY)=KEY the function becomes: 
above-referenced U.S. Pat No. 4,920,415. 

However the key signal from the clip and gain circuit Composite ==FILL*KEY+ BKGD*(i - KEY 2 ) 

14 is input to a transform circuit 22 to produce a pair of 

key signals: the control signal f(KEY) and the control 30 This is very similar to the conventional multiplicative 
key signal KEY*fl[KEY). The transform circuit 22 has a equation except that here BKGD is multiplied by 
programmable read only memory (PROM) or a random (i —KEY 2 ) instead of (1 —KEY). The square of KEY is 
access memory (RAM) 24 to which KEY is input The wnat causes extra BKGD to be added to the composite 
PROM/RAM 24 provides as an output in response to wnere self key error occurs. So implementing this gen- 
KEY the function f(KEY), which is a programmable 3 ^ form produces a multiplicative key with the gap 
function of KEY as described further below. Morethan b ^ k ^ med ^ BKGD, as illus- 

one transfer function may be stored in the PROM/- trated in FIG 3 

RAM 24 so that a CPU (not shown) may select different f(K EY)=l, the function degenerates to the 

functions on the fly as a result of operator action, or the .... , V M ' ^ ' 
CPU may download different transfer functions to the 40 admtrve key equation: 
PROM/RAM. f(KEY) is applied to the first multiplier Composite=FlLL+BKGD*(l— KEY) 

16 to shape or reshape FILL. f(KEY) also is input to a 

second multiplier 26 together with KEY via a function ~. o . „ n mnr ;„ ctt t i, rt i« ™,f ;„ 

switch FS to produce KEY*ffKEY) which is used to S™1/n JTJS, ^V.Z^l 

cut the hole in BKGD. With the function switch FS in « ***** with FILL added to the hole, as ulus- 

its alternate position, a logical "1" is applied to the t ™ ea m ? , * . t . . . enr-c^ ,«rx:v •> 
second multiplier 26, and ifthe PROM/RAM 24 con- a***** fimctlt>n f(KEY)=3*KEY-2- 

tains a unity transfer function so that the output equals : 
the input, then a conventional multiplicative keyer is rwmnnrite fill'(1»key_2- 

emulated. The function stored in the PROM/RAM 24 50 ^kj^+bkgd»(1 - 3*key 2 +2*KEY 3 ) 
controls the behavior of the transition between FILL' 

and BKGa More specifically it affects the shape of the ^ ^ ta impHcations. As is illustrated in 

transition edge. Mulbpher 26 causes *e jetf key &ap mG 5 ^ shaping Q r reshaping of FILL by 
^ associated with the transition to be filled with ^ (3 *KEY — 2*KEV^ results in the fiU transition being 
ITie alternate position of the switch FS is normally S-shape* WMle not linear there are situations when this 
used when the extanal key signal is applied to the clip P rovldes P-»* bcs ^ ^ lev ^ ™*? m 
and gain circuit 14 as a function of the type of source for compressed and are not as noticeable as in an additive 
FILL, Le., whether FILL is already shaped and no ^ Fme d ^ md t»f>hgfrs are reproduced better 
reshaping is desired. For example if the external key has 60 than m a multiplicative key. The self key error is much 
little or no spatial relationship to FILL, Le-, a scene less with a multiplicative key and is filled with 
which is cropped with a box where the external key is BKGD. This function, when applied in the general 
the box, FELL is shaped, a hole is cut in BKGD, and the form, results in a compromise between additive and 
two are add ed . Because this is not a self key, there is no multiplicative key characteristics in that the result is less 
gap although the circuit is still a multiplicative keyer. 65 noisy than the additive key while preserving detail and 
Or if an external chroma keyer input a shaped fill video avoiding the gap of the multiplicative key. 
signal as FILL with an associated key signal, a conven- Another function is fi*KEY)=2— KEY: 
tional multiplicative keyer would produce the gap, so 
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Composite = fill»(2 - KEY) + bkod*(i - 2- means for shaping the fill video signal with the con- 

•KEY+KEY 2 ) trol signal to produce a shaped fill video signal; 

, « . , ^™ , means for cutting a hole in a background video signal 

As illustrated in FIG. 6 this widens the edge of FILL ^ mc mixpr dgnal to produce a shaped 

beyond the additive key and emphasizes the fill edge 5 background video signal; and 

during a transition. In this case BKGD is actually re- me ans for combining the shaped fill and background 

moved because the self key error manifests as an excess video signals to form a composite video signal; 

of FILL. This function accentuates detail in FILL at whereby the background video signal fills a gap in 

the cost of gain in noise. It demonstrates an opposite to ^ composite video signal between the shaped fill 

the multiplicative key and provides an appearance of 10 ^ background video signals, 

resizing the key. 2. The self keyer as recited in claim 1 further compris- 

In fact there exists a continuum of transfer functions mg means f or interactively varying the transfer func- 

that may be applied in the general form expression ^ion. 

which provides the operator of the keyer 10 with flexi- 3 ' The self keyer as recited in claim 1 wherein the 

bility in manipulating the edge of the fill part of the 15 generating means comprises: 

scene while filling the gap caused by self key error with means f or storing the transfer function as a lookup 

background. With such flexibility a graphic interface table that is accessed by the key signal to output the 

may be used to allow more flexible control than simply control signal; and 

selecting a prestored function in the PROM/RAM 24 means for multiplying the control signal by the key 

or one downloaded from the CPU. FIG. 7 shows one 20 si gnal to produce the mixer control signal, 

interface where a display 32 of the transfer function, 4. The self keyer as recited in ftl««n 3 wherein the 

which could be on a screen 34 as shown or in the form multiplying means comprises means for storing a second 

of discrete indicators, is controlled by a plurality of transfer function that is the product of the first transfer 

knobs 36. Each knob 36 controls a point 38 on the trans- function and the key signal, the second transfer function 

fer function. As each knob 36 is manipulated to adjust 25 storing means being accessed by the key signal to output 

the associated point 38 up or down, the CPU 48 finds a the mixer control signal. 

ratio of the adjusted value to a default value that is a 5. A self keying method comprising the steps of: 

straight line function 40. This ratio is f(KEY) for that deriving a key signal from a fill video signal; 

point and may be loaded into the PROM/RAM 24. generating a control signal from the key signal ac- 

Interpolation between values may be used to determine 30 cording to a transfer function and generating a 

f(KEY) between the adjustment points 38, and smooth- mixer control signal that is a function of the control 

ing may be used to make f(KEY) more continuous. A signal and the key signal; 

button 42 may be provided to cause the values con- shaping the fill video signal with the control signal to 

trolled by the knobs 36 to revert to the default values. produce a shaped fill video signal; 

An alternate interface is very similar, only the control 35 cutting a hole in a background video signal with the 
is made from a mouse, trackball, joystick or some other mixer control signal to produce a shaped back- 
computer workstation pointing device. The operator ground video signal; and 

moves a cursor 44 to a point 38 on the transfer function combining the shaped fill and background video sig- 

display 32 and selects it The operator may then adjust nals to form a composite video signal; 

the selected point 46 up or down. An algorithm may be 40 whereby the background video signal fills a gap in 

used so that adjacent points 38 are affected proportion- the composite video signal between the shaped fill 

ally, like moving a point up or down on a stretched and background video signals. 

elastic to smooth the affect of the movement of the 6. The self keying method as recited in claim 5 further 

selected point 46. comprising the step of interactively varying the transfer 

Thus the present invention provides a self keyer that 45 function, 

uses background to fill a gap between fill and back- 7. The self keying method as recited in claim 5 

ground when the two video signals are composited to wherein the generating step comprises the steps of: 

form a single scene, the function being of a general storing the transfer function as a lookup table that is 

flexible form using a key transform function for reshap- accessed by the key signal to output the control 

ing the fill and for cutting a hole in the background for 50 signal; and 

the fill. multiplying the control signal by the key signal to 

What is claimed is: produce the mixer control signal. 

1. A self keyer comprising: 8. The self keying method as recited in claim 7 

means for deriving a key signal from a fill video sig- wherein the multiplying step comprises the step of stor- 

nal; 55 ing a second transfer function that is the product of the 

means for generating a control signal from the key first transfer function and the key signal, the second 

signal according to a transfer function and for gen- transfer function being accessed by the key signal to 

erating a mixer control signal that is a function of output the mixer control signal 

the control signal and the key signal; ***** 
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